Elo Ratings for Structural Credit Assignment in Multiagent Systems

نویسندگان

  • Logan Michael Yliniemi
  • Kagan Tumer
چکیده

In this paper we investigate the applications of Elo ratings (originally designed for 2-player chess) to a heterogeneous nonlinear multiagent system to determine an agent’s overall impact on its team’s performance. Measuring this impact has been attempted in many different ways, including reward shaping; the generation of heirarchies, holarchies, and teams; mechanism design; and the creation of subgoals. We show that in a multiagent system, an Elo rating will accurately reflect the an agent’s ability to contribute positively to a team’s success with no need for any other feedback than a repeated binary win/loss signal. The Elo rating not only measures “personal” success, but simultaneously success in assisting other agents to perform favorably.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Multi-objective multiagent credit assignment in reinforcement learning and NSGA-II

Multiagent systems have had a powerful impact on the real world. Many of the systems it studies (air traffic, satellite coordination, rover exploration) are inherently multi-objective, but they are often treated as single-objective problems within the research. A key concept within multiagent systems is that of credit assignment: quantifying an individual agent’s impact on the overall system pe...

متن کامل

Multi-objective Multiagent Credit Assignment Through Difference Rewards in Reinforcement Learning

Multiagent systems have had a powerful impact on the real world. Many of the systems it studies (air traffic, satellite coordination, rover exploration) are inherently multi-objective, but they are often treated as single-objective problems within the research. A very important concept within multiagent systems is that of credit assignment: clearly quantifying an individual agent’s impact on th...

متن کامل

D++: Structural credit assignment in tightly coupled multiagent domains

Autonomous multiagent teams can be used in complex exploration tasks to both expedite the exploration and improve the efficiency. However, use of multiagent systems presents additional challenges. Specifically, in domains where the agents' actions are tightly coupled, coordinating multiple agents to achieve cooperative behavior at the group level is difficult. In this work, we demonstrate that ...

متن کامل

Evaluating the Factors Affecting on Credit Ratings of Accepted Corporates in Tehran Securities Exchange by Using Factor Analysis and AHP

Implementation credit rating for Corporates is influenced by Different circum-stances, systems, processes, and cultures in each country. In this study, we pro-posed a Factor analysis modified approach for determine important factors on real data set of 123 accepted corporate in Tehran Securities Exchange for the years 2009-2017 of diverse range of 52 variable. We estimated the priority score fo...

متن کامل

Exploiting structure and utilizing agent-centric rewards to promote coordination in large multiagent systems

A goal within the field of multiagent systems is to achieve scaling to large systems involving hundreds or thousands of agents. In such systems the communication requirements for agents as well as the individual agents’ ability to make decisions both play critical roles in performance. We take an incremental step towards improving scalability in such systems by introducing a novel algorithm tha...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 2013